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OVERVIEW 
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HIDDEN MARKOV MODEL BASICS 
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BASIC HIDDEN MARKOV EQUATIONS 
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NEURAL NETWORKS FOR PROBABILITY ESTIMATION 
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Networks are better at probability estimation than competing 
parametric models (e.g., near- neighbor, decision tree methods). 



HYBRID HMM/NEURAL NETWORK MODELS 
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Simple 12 input, 8 hidden units, 4 output units (normal + 3 fault conditions) 
feedforward network trained using conjugate gradient descent. 

Cross-validation indicated that network size wets not important. 



HYBRID HMM/NN FOR FAULT DETECTION 
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34m Antenna Elevation Pointing System 
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SUMMARY OF EXPERIMENTAL RESULTS OBTAINED AT DSS-13 34M ANTENNA 
IN REAL-TIME UNDER NORMAL AND FAULT CONDITIONS 


Class 

Without Markov model 

With Markov model | 

Gaussian 

Neural 

Gaussian 

Neural 

Normal Conditions 

0.36 

1.72 

0.36 

0.00 

Tachometer Failure 

27.78 

0.00 

2.38 

0.00 

Compensation Loss 

34.21 

0.00 

43.16 

o.oo 

All Classes 

16.92 

0.84 

14.42 

o.oo i 


Percentage misclassification rates for Gaussian and neural models 
both with and without Markov component. 


Class 

Without Markov model 

With Markov model 

Gaussian 


Gaussian 

Neural 

Normal Conditions 

-2.44 


-2.46 

-4.24 

Tachometer Failure 

-0.40 

-3.52 

-0.42 

-4.22 

Compensation Loss 

-0.82 

-3.48 

-1.39 

-4.71 

All Classes 

-0.87 

-2.29 

-1.02 

-4.34 


Logarithm of Mean Squared Error for Gaussian and neural models 
both with and without Markov component (more negative is better). 
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With hidden Markov model 
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DETECTING NOVEL STATES 



87 


• p(x\u) m +i) is determined a priori, e.g., a non-informative prior density. 
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CONCLUSION 
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NN/HMM monitoring model is currently being integrated with the new 
DSN antenna controller software: will be on-line monitoring a new DSN 
34m antenna (DSS-24) by July. 





